Evaluating Research Impact Based on Semantic Scholar Highly Influential Citations, Total Citations, and Altmetric Attention Scores: The Quest for Refined Measures Remains Illusive
نویسندگان
چکیده
Background: The evaluation of scholarly articles’ impact has been heavily based on the citation metrics despite limitations this approach. Therefore, quest for meticulous and refined measures to evaluate publications’ is warranted. Semantic Scholar (SS) an artificial intelligence-based database that allegedly identifies influential citations defined as “Highly Influential Citations” (HICs). Citations are considered highly according SS when cited publication a significant citing (i.e., citer uses or extends work). Altmetrics online attention research mined from activity in tools environments. Aims: current study aimed explore whether HICs provide added value it comes measuring compared total counts Altmetric Attention Score (AAS). Methods: Dimensions was used generate dataset study, which included COVID-19-related articles published by researchers affiliated Jordanian institutions. Explorer selected altmetrics harvesting tool, while extract details related HICs. A 618 publications comprised final dataset. Results: Only 4.57% (413/9029) compiled were classified Based categories intent, 2626 background (29.08%, providing historical context, justification importance, and/or additional information paper), 358 result (3.97%, extend findings previously conducted), 263 method (2.91%, use established procedures experiments determine results consistent with studies). No correlation found between AAS (r = 0.094). Manual inspection revealed substantial contradictions, flaws, inconsistencies tool. Conclusions: gauging significantly limited due enigmatic its calculation dependence intelligence. Along already documented drawbacks AASs, continuous existing conception novel approaches recommended improve reliability assessment.
منابع مشابه
Модель предметной области на основе сервиса Google Scholar Citations (A Domain Model Created on the Basis of Google Scholar Citations)
متن کامل
The relationship between altmetric score with received citations
Today, in addition to citations and with the expansion of social Background: media, the use of altmetrics has gained attention as a tool necessary for evaluating the effects of scientific publications. The present study intended to monitor Iranian pediatrics articles, as one of the leading areas of scientific publications in Iran, between the years 2010-2016 using altmetrics and citation-metric...
متن کاملThe relationship between altmetric score with received citations
Today, in addition to citations and with the expansion of social Background: media, the use of altmetrics has gained attention as a tool necessary for evaluating the effects of scientific publications. The present study intended to monitor Iranian pediatrics articles, as one of the leading areas of scientific publications in Iran, between the years 2010-2016 using altmetrics and citation-metric...
متن کاملDo altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
An extensive analysis of the presence of different altmetric indicators provided by Altmetric.com across scientific fields is presented, particularly focusing on their relationship with citations. Our results confirm that the presence and density of social media altmetric counts are still very low and not very frequent among scientific publications, with 15%-24% of the publications presenting s...
متن کاملMining Google Scholar Citations: An Exploratory Study
The official launch of Google Scholar Citations in 2011 opens a new horizon for analyzing the citations of individual researchers with unprecedented convenience and accuracy. This paper presents one of the first exploratory studies based on the data provided by Google Scholar Citations. More specifically, we conduct a series of investigations on: i) the overall citation patterns across differen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Publications
سال: 2023
ISSN: ['2304-6775']
DOI: https://doi.org/10.3390/publications11010005